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STABLE SIGNAL RECOVERY FROM PHASELESS MEASUREMENTS 


BING GAO, YANG WANG, AND ZHIQIANG XU 


Abstract. The aim of this paper is to study the stability of the li minimization for the 
compressive phase retrieval and to extend the instance-optimality in compressed sensing to 
the real phase retrieval setting. We first show that the m = 0{klog{N/k)) measurements 
is enough to guarantee the h minimization to recover fc-sparse signals stably provided 
the measurement matrix A satisfies the strong RIP property. We second investigate the 
phaseless instance-optimality with presenting a null space property of the measurement 
matrix A under which there exists a decoder A so that the phaseless instance-optimality 
holds. We use the result to study the phaseless instance-optimality for the norm. 
The results build a parallel for compressive phase retrieval with the classical compressive 
sensing. 


1. Introduction 

In this paper we consider the phase retrieval for sparse signals with noisy measurements, 
which arises in many different applications. Assume that 

bj :=\{aj,xo)\+ej, j = 

where xq G aj G and ej G M is the noise. Our goal is to recover xq up to 
a unimodular scaling constant from b := {bi,. . . ,bm)~^ with the assumption of xq being 
approximately Usparse. This problem is referred to as the compressive phase retrieval 
problem [9]. 

The paper attempts to address two problems. Firstly we consider the stability of li min¬ 
imization for the compressive phase retrieval problem where the signal xq is approximately 
Usparse, which is the minimization problem defined as follows: 

(1.1) min||x||i subject to |||Aa:| — |Axo|II 2 < e, 

where A := [oi,..., 0 ^]"'" and |Axo| := [|(ai,xo)|, • • •, l(am,xo)|]''~- Secondly we investigate 
the instance-optimality in the phase retrieval setting. 

Note that in the classical compressive sensing setting the stable recovering a fe-sparse 
signal xq G C'^ can be done using m = 0{k\og{N/k)) measurements for several classes of 
measurement matrices A. A natural question is whether stable compressive phase retrieval 
can also be attained with m = 0{k\og{N/k)) measurements. This is indeed proved to 
be the case in [7] if xq G and A is a random real Gaussian matrix. One drawback is 
that the recovery method presented in [7] is computationally unfeasible. In [8] a two-stage 
algorithm for compressive phase retrieval is proposed, which allows for very fast recovery 
of a sparse signal if the matrix A can be written as a product of a random matrix and 
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another matrix (such as a random matrix) that allows for efficient phase retrieval. The 
authors also proved that stable compressive phase retrieval can be achieved with m = 
0{k\og{N/k)) measurements also for complex signals xq. In this paper, we shall show 
that the minimization scheme given in (11.11) will recover a fc-sparse signal stably from 
m = 0{k \og{N/k)) measurements, provided that the measurement matrix A satisfies the so- 
called strong RIP (S-RIP) property. This establishes an important parallel for compressive 
phase retrieval with the classical compressive sensing. Note that in m such a parallel in 
terms of the null space property was already established. 

The notion of instance optimality was first introduced in [T]. Given a norm || • ||x such 
as the .^i-norm and x G the best fe-term approximation error is dehned as 

crk{x)x ■= min ||x - zllx, 

where 

Sfc ;= {x G : ||x||o < k}. 

We use A : i—)• to denote a decoder for reconstructing x. We say the pair {A, A) is 

instance optimal of order k with constant Cq if 

(1.2) ||x - A(^x)||x < CQak{x)x 

holds for all x G M'^. In extending it to phase retrieval, our decoder will have the input 
b = \ Ax\. A pair (A, A) is said to be phaseless instance optimal of order k with constant Cq 
if 

(1.3) minjlla: - A(|Ax|)||x, ||a: A(|Ax|)||x| < Coakix)x 

holds for all x G We are interested in the following problem : Given || • ||x and k < N, 
what is the minimal value of m for which there exists {A, A) so that il.3\) holds? 

The null space Af{A) := {x G : Ax = 0} of A plays an important role in the analysis 
of the original instance optimality (jl.2p (see m)- Here we present a null space property for 
AA(A), which is necessary and sufficient, for which there exists a decoder A so that (|1.3I) 
holds. We apply the result to investigate the instance optimality where X is the ii norm. 
Set 

Ai(|Ax|) := argminj ||^;||i ; \Ax\ = \Az\ >. 

We show that the pair (A, Ai) satisfies the ()1.3p with X = £i-norm provided A satisfies 
the strong RIP property (see Definition 12.ip . As shown in m, the Gaussian random 
matrix A G satisfies the strong RIP of order k for m = 0{k\og{N/k). Hence 

m = 0{k\og{N/k)) measurements suffice to ensure the phaseless instance optimality (11.31) 
for £i-norm exactly as with the traditional instance optimality (11.21) . 

2. Auxiliary Results 

In this section we provide some auxiliary results that will be used in later sections. For 
X G we use ||x||p := ||x||£p to denote the p-norm of x for 0 < p < oo. The measurement 
matrix is given by A ;= [ai,..., G as before. Given an index set I C {1,..., m} 

we shall use Aj to denote the sub-matrix of A where only rows with indices in I are kept, 
i.e., 


A/ [uj : j G 
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The matrix A satisfies the Restricted Isometry Property (RIP) of order k if there exists a 
constant 5^ £ [0,1) such that for all fc-sparse vectors z £ we have 

(1 ~ ^ (1 + '^fc)ll^ll2- 


It was shown in [5] that one can use Ii minimization to recover fe-sparse signals provided 
that A satisfies the RIP of order t ■ k and 6t.k < \J^ ~ \ where t > 1. 


To investigate compressive phase retrieval, a stronger notion of RIP is given in m-- 

Definition 2.1. (S-RIP): We say the matrix A = [ai,--- ^ has the Strong 

Restricted Isometry Property of order k with bounds 6-, 0+ £ (0,2) if 

(2.1) 0 _||x ||2 < min IIRl^IIo < max IIRt-xIIo < 0 +||x ||2 

/C[m],|/|>m/2 IQ[m\,\I\>m/2 


holds for all k-sparse signals x £ , where [m] := {1,... ,m}. ITe say A has the Strong 

Lower Restricted Isometry Property of order k with bound 9- if the lower bound in a 
holds. Similarly we say A has the Strong Upper Restricted Isometry Property of order k 
with bound 6+ if the upper bound in 112.1\) holds. 


The authors of |10] proved that Gaussian matrices with m = 0{tk\og{N/k)) satisfy 
S-RIP of order tk with high probability. 

Theorem 2.1 ( [lO])' Suppose that t > 1 and A = (ojj) £ is a random Gaussian 

matrix with m = 0{tklog{N/k)) and aij ~ Then there exist £ (0,2) 

such that with probability 1 — exp (—cm/2) the matrix A satisfies the S-RIP of order tk with 
eonstants 6- and where c> 0 is an absolute constant and 0+ are independent oft. 


The following is a very useful lemma for this study. 

Lemma 2.1. Suppose that xq £ and p > 0. Suppose that A £ is a measurement 

matrix satisfying the restrieted isometry property with Stk < some t > 1. Then 

for any 


X £ |x £ : ||x||i < ||xo||i + p, \\Ax — ^Xo ||2 < e| 


we have 


I - II ^ I 2(T/j(xo)i p 

\x - X 0 II 2 < Cie -h C2— -^=-h C2 • 


where ci 


-v/2(l+<5) _ V2S-\-^J^t{t-l)-5t)5 ^ 


Remark 2.1. We build the proof of Lemma [2T] following the ideas of Cai and Zhang [5]. The 
full proof is given in Appendix for completeness. It is well-known that an effective method 
to recover approximately-sparse signals xq in the traditional compressive sensing is to solve 

(2.2) := argmin{||x||i : ||Ax — Axo ||2 < e}- 

X 


The definition of x^ shows that 

||a^^||i < Ikolli) ||Ax^ 


Axo\\2 < e. 


X* - X0II2 < Cie + C2 


^kixo)i 

y/k 


which implies that 












4 


BING GAO, YANG WANG, AND ZHIQIANG XU 


provided that A satisfies the RIP condition with 6tk < a/1 — l/t for t > 1 (see 0). However, 
in practice one prefers to design fast algorithms to find an approximation solution of (j2.2p . 
say X. Thus it is possible to have ||x||i > UxoHi- Lemma I tT] gives an estimation of ||a; —X 0 II 2 
for the case where ||x||i < ||xo||i + p- 


3. Stable Recovery of Real Phase Retrieval Problem 


3.1. Stability Results. The following lemma shows that the map (f)A{x) '■= \Ax\ is stable 
on Sfc modulo a unimodular constant provided A satisfies strong lower RIP of order 2k. 
Define the equivalent relation ~ on and by the following: for any x ~ y iff x = cy 
for some unimodnlar scalar c, where x,y are in or C'^. For any subset Y of or 
the notation Yj ^ denotes the equivalent classes of elements in Y under the equivalence. 
Note that there is a natural metric Dr^ on ~ given by 


Dr^{x, y) = min ||x — cy||. 

|c|=l 

Our primary focus in this paper will be on and in this case Dr.,{x,y) = min{||x — 

y||2,lk + y||2}- 


Lemma 3.1. Let A £ satisfy the strong lower RIP of order 2k with constant 0_. 

Then for any x, y £ we have 


|||Hxl - \Ay\\\l > e_mm{\\x - y\\l,\\x + y\\l). 


Proof. For any x,y £ Sfc we divide {1, ... ,m} into two groups: T = {j : sign((aj,x)) = 
sign((aj, y))} and T'^ = {j : sign((aj,x)) = —sign((aj, y))}. Clearly one of T and will 
have cardinality at least m/2. Without loss of generality we assume that T has cardinality 
no less than m/2. Then 


> 

> 

> 


\\Atx - Hrylli + \\At<^x + HT^ylli 
\\Atx - ATy\\2 

G-\\x - y\\l 

6- mm{\\x - y\\l,\\x + y\\l). 


Remark 3.1. Note that the combination of Lemma \3.1\ and Theorem \2.1\ shows that for an 
m X N Gaussian matrix A with m = 0(A:log(A^/A:)) one can guarantee the map 4>a{x) '.= 
\Ax\ is stable on 


3.2. The Main Theorem. In this part, we will consider how many measurements are 
needed for the stable sparse phase retrieval by £i-minimization via solving the following 
model: 

(3.1) min||x||i subject to |||Hx| — |Hxo|||i < e^, 

where A is our measurement matrix and xq £ is a signal we wish to recover. The next 
theorem tells under what conditions the solution to (j3.ip is stable. 

Theorem 3.1. Assume that A £ satisfies the S-RIP of order tk with bounds 0_, 0+ £ 

(0,2) such that 

r 1 1 

t > maxi-^^ 1. 

^2d_-eV 2e+-ey 
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Then any solution x for (E2P satisfies 


min{||x - X 0 II 2 , II® + ^olb} < cie + C 2 


2o'fc(®o)] 

y/k 


where ci and C 2 are constants defined in Lemma \2.1 


Proof. Clearly any x G satisfying m mnst have 

(3.2) ||x||i < lixolli 

and 


(3.3) \\\Ax\ -\Axo\\\l < . 

Now the indices set {1,2,..., m} is divided into two subsets 

T = {j : sign{{aj,x)) = sign((aj, xq))} 

= {j : sign((aj,x)) = -sign((aj, xq))}. 

Then (I3.3ji implies that 

(3.4) ||2lrx — ^T^olli + II^T':® + At<^xq\\2 < 

Here either |T| > m/2 or |T'^| > m/2. Without loss of generality we assume that |T| > m/2. 
We use the fact 


(3.5) ||Hrx - HtxoIII < e^. 

From (13.2[) and ()3.5j) we obtain 

(3.6) X G {x G : ||x||i < ||xo||i, \\Atx - AtXq \\2 < e}. 


Recall that A satisfies S-RIP of order tk and constants 0_, Here 

1 1 


(3.7) 


t > max{ 


26- - el ’ 26+ - 6% 


}> 1 . 


The definition of S-RIP implies that At satisfies the RIP of order tk in which 


(3.8) 


dtk < maxjl — 6-, 6+ 



where the second inequality follows from (13.71) . The combination of (j3.6p . (j3.8p and Lemma 
[Q now implies 


I® - ®o ||2 < Cie + C 2 


2crfc(xo)i 

y/k 


where ci and C 2 are defined in Lemma l2.II If IT'^I > ^ we get the corresponding result 


® + ®o ||2 < Cie + C 2 


2q-fc(®o)i 

Vk 


The theorem is now proved. I 

This theorem demonstrates that, if the measurement matrix have the S-RIP, real com¬ 
pressive phase retrieval problem can be solved stably by ^i-minimization. 
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4. Phase Retrieval and Best k-term Approximation 

4.1. Instance optimality from the linear measurements. We introduce some defini¬ 
tions and results in [T]. Recall that for a given encoder matrix A € and a decoder 

A : I—>• , the pair {A, A) is said to have instance optimality of order k with constant 
Cq with respect to the norm X if 

(4.1) \\x - A(Ax)||x < Coakix)x 

holds for all x G M^. Set Af{A) := {r] G : Arj = 0} to be the null space of A. The 
following theorem gives conditions under which the (14.ip holds. 

Theorem 4.1 ( [T]). Let A G , 1 < k < N and || • ||jv be a norm. Then a sufficient 

condition for the existence of a decoder A satisfying hfA] ) is 

(4.2) IlhlU < ^o'2fc(??)v, V7 /gW(A). 

A necessary condition for the existence of a decoder A satisfying ezp is 

(4.3) Mix <Coa2k{r])x, 'ir]£M{A). 

For the norm X = .^i it was established in [T] that instance optimality of order k can 
indeed be achieved, e.g. for a Gaussian matrix A, with m = 0{klog{N/k)). The authors 
also considered more generally taking different norms on both sides of (14.ip . Following [T], 
we say the pair (A, A) has {p,q)-instance optimality of order k with constant Co if 

(4.4) ||x - A { Ax)\\ip < Coak { x ) eJk ^^^~^^‘^, Vx G 

with 1 < q < p < 2. It was shown in [T] that the {p, g)-instance optimality of order k can 
be achieved at the cost of having m = 0{k{N/k)'^~‘^^\og{N/k) measurements. 

4.2. Phaseless Instance Optimality. A natural question here is whether an analogous 

result of Theorem O exists for phaseless instance optimality defined in (11.31) . We answer 
the question by presenting such a result in the case of real phase retrieval. 

Theorem 4.2. Let A G , 1 < k < N and || • ||x be a norm. Then a sufficient 

condition for the existence of a decoder A satisfying the phaseless instance optimality im 
is: For any / C {1,... , m} and rji G J\f{Aj), rj 2 G M{Aic) we have 

(4.5) min{||r?i||x, ||r? 2 ||A} < - m)x + -Y^k{vi+m)x- 

A necessary condition for the existence of a decoder A satisfying il.3\) is: For any L C 
{1,..., m} and rji G J\f{Aj), r ]2 G M{Aic-) we have 

C C 

(4.6) min{||7/i||x, ||i? 2 ||a} < - m)x + -^o-fc(??i + m)x- 

Proof. We first assume (14.5p holds, and show that there exists a decoder A satisfying the 

phaseless instance optimality (jl.3p . To this end, we define a decoder A as follows: 

A(|Axo|) = argmin ak{x)x- 
\Ax\ = \Axo\ 
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Suppose X := A(|Axo|). We have \Ax\ = \ Axq\ and o'k{x)x < <Tfc(a^o)x- Note that {aj,x) = 
±{aj,xo). Let I C {1,..., m} be defined by 

I = [j ■■ {aj,x) = {aj,xo)y 


Then 

Set 


Ai{xo — x) = 0, Ajc^xq + x) = 0. 


r]i:= xq-x e Af{Ai), 
r]2 := xo + X e M{Aic). 

A simple observation yields 

(4.7) akim - r]2)x = 2(Tfc(x)x < 2fjfc(xo)x, CTkim + r]2)x = 2ak(xo)x- 

Then ()4.5p implies that 

min{||x - xollx, P + 3 :o||a} = min{||7?i||x, ||?? 2 ||a:} 

< ^o-k(m - r/2)x + ^CTkim + r]2)x 

< Coak{xo)x- 

Here the last equality is obtained by (14.71) . This proves the sufficient condition. 

We next turn to the necessary condition. Let A be a decoder for which the phaseless 
instance optimality (11.31) holds. Let I C {1,... ,m}. For any r]i S Af{Aj) and rj 2 G M{Ajc) 
we have 


(4.8) \A{r]i + r] 2 )\ = \A{r]i - r] 2 )\ = \A{r ]2 - Vi)\- 
The instance optimality implies 

(4.9) min{||A(|A(r?i+7?2)|) + 7?i+^2||x, ||A(|A(?7i+ 772 )]) - (r/i+?? 2 )lk} < Coak{r]i + m)x- 
Without loss of generality we may assume that 

\\^{\A{m + m)\) + m + mWx < ||A(|A( 7 ?i+ 772)!) - (771+ h2)l|A. 

Then (14.9p implies that 

(4.10) ||A(|A(77i + 772 )!) + m + ^ 2 ||a: < Coakim + r] 2 )x- 
By (|4.8I) . we have 

||A(|A( 77 i + 772)1) + 771 + 772IIX 

= ||A(|A(772 - 77i)|) - (772 - 771 ) + 2772 IIX 

(4.11) > 2||772||jv - ||A(|A(772 - 771 )]) - (772 - 77i)||x. 

Combining (I4.10p and (14.111) yields 

(4.12) 2||772||x < C'oiTfc(77i + 772 )^ + ||A(|A(772 - 771 )]) - (772 - 77i)||x. 

At the same time, (14.8p also implies 

||A(|A( 77 i + 772)1) + 771 + 772IIX 

= I|A(|A(772 - 77i)|) + (772 - 771) + 277 i||x 
> 2||77i||x - ||A(|A(772 - 77i)|) + (772 - 77i)||x. 


(4.13) 
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Putting (14.101) and (I4.13P together, we obtain 

(4.14) 2||r/i||x < Coakim +r] 2 )x + \\A{\A{r ]2 + iV 2 -Vi)\\x- 

It follows from (j4.12p and (14.141) that 

min{||? 7 i||x, \\V 2 \\x} < +m)x+ 

i min{||A (|^(??2 - Vi)\) - im - m)\\x, \\A{\A{r ]2 - 7 ?i)|) + (m - Vi)\\x} 

< + V 2 )x + ^cTkivi - m)x- 

Here the last inequality is obtained by {A, A) satisfying the instance optimality. For the 
case where 

||A(|H(77i+ ry2)|) - (7?i+ 772)||x < ||A(|H(r/i + 772 )!) + + r/2||x, 

we obtain 

Co Cq 

min{||r/i||x, ||?72||x} < -^^kim + V 2 )x + ^CTkim -m)x 

by the similar way. The theorem is now proved. I 

We next present a null space property for phaseless instance optimality, which allows us 
to establish parallel results for sparse phase retrieval. 

Definition 4.1. We say a matrix A S satisfies the strong null space property (S- 

NSP) of order k with constant C if for any index set I C { 1 ,... ,m} with |/| > m/2 and 
T] e M{Aj) we have 

\\r]\\x < C • <Tk{rOx- 

Theorem 4.3. Assume that a matrix A G has the strong null space property of order 

2k with constant 6 * 0 / 2 . Then there must exist a decoder A having the phaseless instance 
optimality with constant Cq. In particular, one such decoder is 

AdHxol) = argmin akix)x- 
\Ax\=\Axo\ 

Proof. Assume that I C { 1 ,... ,m}. For any r]i G M{Aj) and r ]2 G M{Aic) we must have 
either || 7 ?i||x < ^cr 2 k{vi)x or ||? 72 ||x < ^(y 2 k{V 2 )x by the strong null space property. If 
||i?i|U < ^(X 2 k{hi)x then 

WmWx < ^CF2k{jll)x < -I/2)a + +I?2)x- 

Similarly if ||? 72 ||a < ^cr 2 kih 2 )x we will have 

II^IIa < ^cr 2 k{m)x < - m)x + + m)x- 

It follows that 

Cq Cq 

(4.15) min{|| 7 ?i||x, \\V 2 \\x} < -^(^k{m - m)x + -^crkihi + m)x- 

Theorem 14.21 now implies that the required decoder A exists. Furthermore, by the proof of 
the sufficiency part of Theorem 14.21 

A(|Axo|) = argmin ak{x)x 
\Ax\ = \Axo\ 
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is one such decoder. 


4.3. The Case X = i\. We next apply Theorem 14.31 to the case X = i\ norm. The 
following lemma establishes a relation between S-RIP and S-NSP for the £i-norm. 


Lemma 4.1. Let a,b,k be integers. Assume that A S satisfies the S-RIP of order 

(o + b)k with constants 9-, 0+ € ( 0 , 2 ). Then A satisfies the S-NSP under the ii-norm of 
order ak with constant 


Co 


1 + 


a(l + 5) 


where 5 is the restricted isometry eonstant and 5 := max{l — 0 _, 0 + — 1 } < 1 . 


We remark that the above lemma is the analogous to the following lemma providing a 
relationship between RIP and NSP, which was shown in [T]: 

Lemma 4.2 ( [T], Lemma 4.1). Let a = l/k, b = V/k where 1,1' > k are integers. Assume 
that A £ gQfigflgg ifig jijp qJ order {a -\- b)k with 6 = S(^a-\-b)k < 1- Then A satisfies 

the null space property for the ii-norm of order ak with constant Cq = 1 + 


Proof of Lemma 14.11 By the definition of S-RIP, for any index set I C m} with 

|/| > m/2, the matrix Aj £ satisfies the RIP of order (o -|- b)k with constant 

^{a+h)k = d := max{l — — 1} < 1. It follows from Lemma 14.21 that 

for all 1] £ Afi^Ai). This proves the lemma. I 

Set 0 = 2 and 6 = 1 in Lemma l4.II we infer that for the £i-norm if A satisfies the S-RIP 
of order 3A; with constants 6-, 0+ £ ( 0 , 2 ), then A satisfies the S-NSP of order 2k with 

constant Cq = 1 -|- ■ Hence by Theorem 14.31 there must exist a decoder that has 

the instance optimality under the .£i-norm with constant 2Co. According to Theorem 12.11 
by taking m = 0{klog{N/k)) a Gaussian random matrix A satisfies S-RIP of order 3k 
with high probability. Hence, there exists a decoder A so that the pair {A, A) has the the 
^i-norm phaseless instance optimality at the cost of m = 0{k\og{N/k)) measurements, as 
with the traditional instance optimality. 

We are now ready to prove the following theorem on phaseless instance optimality under 
the X = .^i-norm. 

Theorem 4.4. Let A £ R”*^^ satisfy the S-RIP of order t ■ k with constants 0 < 9- < 1 < 
0 + < 2, where 

Let 

(4.16) A(|Axo|) = argmin{||x||i : \Ax\ = |Axo|} • 
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Then (^, A) has the ii-norm phaseless instance optimality with constant C = 2 -Cq ’ where 
Co = 1 + as before 

(5 := max{l — 0 _, 0 + — 1 } < 1 — —. 

Proof. Let xq G and set x = Ad^d^ol). Then by definition 

ll^lli < ll^olli and \Ax\ = |^xo|. 

Denote by / C {1 ,..., m} the set of indices 

I = {j ■ {aj,x) = {aj,xo)} , 
and thus {aj,x) = —{aj,xo) for j G P. It follows that 

Ai{x — Xq) = 0 and Ajc^x + xq) = 0. 

Set 

r] := X — Xq £ J\f{Ai). 

We know that A satisfies the S-RIP of order tk with constants 0_, 6+ where 


. 2 2 


> 2 . 


For the case |/| > m/2, Aj satisfies the RIP of order tk with RIP constant 

2 

d = htk '■= max{l — 0_,0+ — 1} < 1 — — < I. 

Take a := 1, b := t — 1 in Lemma l4.II Then A satisfies the £i-norm S-NSP of order k with 
constant 


Co = l + 


1 + 5 


< 2. 


This yields 

(4.17) hill < Co||77TdlD 

where T is the index set for the k largest coefficients of xq in magnitude. Hence hrlli < 
(Co — l)h'r=||i. Since ||x||i < ||xo||i we have 

holli > ||x||i = ||xo + ??||i = ||xo,T + xo,T<^ + + ??rdli 

> ho,T||i — ho,Tdli + hT^li “ hrili- 

It follows that 

\\vt4i < WvtWi + 2crfc(xo)i < (Co - l)hrdli + 2(Tfc(xo)i 

and thus 


Now (I4.17P yields 
which implies 


hT^lll < 2 - (j^ ^4xo)l- 
2Cq 

hill < Co\\riT4i < 2_^^ ^fc(^o)i> 

1^ - icolli < Co\\r]T4i < 7r-^^k{xo)i- 

2 — Go 
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For the case |/'^| > m/2 identical argument yields 

2(7 

11^ + a^olli < C'oIIt/tHIi < A— 

^ — Uq 

The theorem is now proved. I 

From Theorem l2.ll we know that anmxN random Gaussian matrix with m = 0{tk log{N/k)) 
satisfies the S-RIP of order tk with high probability. We therefore conclude that the £i-norm 
phaseless instance optimality of order k can be achieved at the cost of m = 0{tk\og{N/k)) 
measurements. 


4.4. Mixed-Norm phaseless Instance Optimality. We now consider mixed-norm phase¬ 
less instance optimality. Let 1 < q < p < 2 and s = l/q — 1/p. We seek estimates of the 
form 

(4.18) min{||x - A(|^x|)||p, ||x + A(|^x|)||p} < Cok~'‘ak{x)q 

for all X € We shall prove both necessary and sufficient conditions for mixed-norm 

phaseless instance optimality. 

Theorem 4.5. Let A G and I < q < p < 2. Set s = 1/q — 1/p. Then a decoder A 

satisfying the mixed norm phaseless instance optimality with constant Cq exists if: 

for any index set / C {1,.. . , m} and any t]i G Af{Aj), r ]2 G J\f{Ajc) we have 

(4.19) min{||? 7 i||p, IIpsIIpI < -^k-^(^ak{vi - V 2 )q + (Xkivi + V 2 )qy 

Conversely, assume a decoder A satisfying the mixed norm phaseless instance optimality 
I/. j<gD exists. Then for any index set I C {1,... , m} and any rji G M{Ai), r ]2 G J\f{Ajc) we 
have 

min{llhillp> Ilh 2 ||p} < - 172)9 + o-fc(77i-h 772 )^). 

Proof. The proof is virtually identical to the proof of Theorem 14.21 We shall omit the 
details here in the interest of brevity. I 

Definition 4.2. (Mixed-Norm Strong Null Space Property) We say that A has the mixed 
strong null space property in norms {£p,iq) of order k with constant C if for any index set 
/ C {1, ... ,m} with |/| > m/2 the matrix Aj G satishes 

WvWp < Ck~‘'ak{ri)q 

for all ?7 G M{Ai), where s = 1/q — 1/p. 


The above is an extension of the standard definition of the mixed null space property of 
order k in norms {ip,iq) (see [T]) for a matrix A, which requires 

WvWp < Ck~''ak{'n)q 

for all 77 G M{A). We have the following straightforward generalization of Theorem 14.31 


Theorem 4.6. Assume that A G 


hmxN 


has the mixed strong null space property of order 


2k in norms {ip,iq) with constant Cq/ 2, where 1 < q < p <2. Then there exists a decoder 
A such that the mixed-norm phaseless instance optimality holds with constant Cq. 
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We establish relationships between mixed-norm strong null space property and the S-RIP. 
First we present the following lemma that was proved in [T]. 

Lemma 4.3 ( [I], Lemma 8.2). Let k > 1 and k = k{^)‘^~‘^/^. Assume that A G 
satisfies the RIP of order 2k + k with S := (^ 2 fc+fc ^ A satisfies the mixed null space 

property in norms {ip,iq) of order 2k with constant Cq = w 


Proposition 4.1. Let k > 1 and k = k{^)‘^ Assume that A G satisfies the S- 

RIP of order 2k+ k with constants 0 < 0- < 1 < 9^ < 2. Then A satisfies the mixed strong 
null space property in norms (ip, Iq) of order 2k with constant Co = 

2k+k 


where 6 is the RIP constant and 6 := dr ,,^, r = max{l — 0_, 0+ — 1}. 


Proof. By dehnition for any index set I C {1, ... ,m} with |/| > m/2, the matrix Aj G 
I^|/|xA gatishes RIP of order 2k + k with constant Cq = -|- ‘ 2 Atv-^l<i^ where 

(5 is the RIP constant and b := = max{l — 6_,9^ — 1}. By Lemma 14.31 we know 

that Aj satishes the mixed null space property in norms {ip,iq) of order 2k with constant 

Co = -|- 2^/^’“^/'?, in other words for any rj G Af{Aj), 

\\r]\\p < CA:"V2fc(r?)g. 

So A satishes the mixed strong null space property. I 


Corollary 4.1. Let k > 1 and k = k{^)‘^ Assume that A G satisfies the S-RIP 

of order 2k + k with constants 0 < 9- < 1 < 9+ < 2. Let b := (52fc+fc = max{l —0_,0_|_ —1} < 
1. Define the decoder A for A by 


(4.20) 


A(|Axo|) = argmin ak{x)g. 
|Ax| = |Axo| 


Then Ii4.18\ ) holds with constant 2Co, where Cq = 2^/p+^/^a/^^ -|- 2^/p . 


Proof. By the Proposition 14.11 the matrix A satishes the mixed strong null space property 
in {ip,iq) of order 2k with constant Cq = -|- 2^/^“^/'^. The corollary now 

follows immediately from Theorem 14.61 I 

Remark 4.1. Combining Theorem 12.II and Corollary 14.11 the mixed phaseless instance op¬ 
timality of order k in norms {£p, iq) can be achieved at the price of 0{k{N/k)‘^~‘^/^ \og{N/k)) 
measurements, just as with the traditional mixed (£p,£q)-norm instance optimality. Theo- 
rem l3.1l imphes that the ii decoder satishes the {p, q) = (2, 1) mixed-norm phaseless instance 
optimality at the price of 0{k\og{N/k)) measurements. 


5. Appendix: Proof of Lemma ItT] 


We will hrst need the following two Lemmas to prove Lemma l2.ll 
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Lemma 5.1 (Sparse Representation of a Polytope [5l[T2]). Let s > 1 and a > 0. Set 
T{a,s) := |n £ M” : ||n||oo < ||i^||i < sa|. 

For any v G M” let 

U (a, s, n) := |n G M"" : supp(n) C supp(?;), ||n||o < s,||ii||i = HiiHiJIiilloo < ce|- 

Then v G T{a,s) if and only if v is in the convex hull of U{a,s,v), i.e. v can be expressed 
as a convex combination of some ni,..., un in U{a, s, v). 


Lemma 5.2 (Lemma 5.3 in [3]). Assume that ai > 02 > • • • > Om ^ 0- Let r < m and 
A > 0 such that Yli=i Ri + A > YllLr+i Then for all a > 1 we have 


(5.1) 


m 


E ““S’- 

j=r+l 



In particular for X = 0 we have 


m r 



j=r-\-l i=l 


We are now ready to prove Lemma l2.II 

Proof of Lemma 12.IL Set h := x — xq- Let Tq denote the set of the largest k coefficients 
of Xq in magnitude. Then 

Ikolli + P> Pill = Po + ^lli 

= Po,To + Po + + Pp'^lll 

> Po,Tol|l - pTolll - Po.Tp'^lll + l|P|jl|l- 

It follows that 

\\hT§\\l < pTolll + 2pO,ToH|l + P 
= IIPolli +2crfc(xo)i + p. 

Suppose that So is the index set of the k largest entries in absolute value of h. Then we 
can get 

p5g||i < IIP^IIi < IIPolli + 2<Tfc(3:o)i + p 

< IIPolli + 2fJfc(xo)i + p. 

Set 

IIPolli + 2crfc(3:o)i + p 


a := 


k 


We divide hs^ into two parts , where 

:= hs- ■ I{r.\hsc(i)\>a/{t-l)}: := hs§ • I{r.\hs.{i)\<a/(t-l)}- 

A simple observation is that ||/i(^)||i < ||pg||i < otk. Set 

I-.= |supp(p))| = ||p)||o. 
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Since all non-zero entries of have magnitude larger than a/{t — 1), we have 

at>||/.C)|li= E |/.W(.)I> E = 

2GSUpp(/l(^)) 2ESUpp(/l(^)) 

which implies i < {t — l)k. Thus we have: 

( 5 . 2 ) {A{hs, + h^^^),Ah) < \\A{hs, + h^^^)\\2 • WAhh <VTTd-\\hs,+h^^'>\\ 

Here we apply the facts that ||/i 5 p -|- /i^^^||o = i + k < tk and A satisfies the RIP o 
with 6 := 5^. We shall assume at first that tk as an integer. Note that ||/i^^^||oo 1 

(5.3) ||/»PI||, = Ilfcsslli - l|M‘)||i <ka--^^ {k{t - 1) - t]j^. 

We take s := k{t — 1) — i in Lemma l5.II and obtain that is a weighted mean 


N N 

^ \iuu 0 < Ai < 1, Ai = 1 

i=l i=l 

where ||«i ||o < k{t — 1) — ||i, \\ui\\oo < C(/ (t — 1) and supp(«i) C 

Hence 


||l^i||2 ^ 's/ 111^2 11 0 ll’l^^lloo - \/ k(t 1) £‘ 11112 1100 

E \/ k(t 1) 11 Halloo 
< a^Jk/{t — 1). 

Now for 0 < ^ < 1 and d > 0, which will be chosen later, set 

:= hso + + fi-Uj, j = 


Then for fixed i € [1, N] 


N 

f=i 


hso + + k' • - djdi 

(1 - /i - d)(/i5o + - dfiUi + k^. 


Recall that a = ll^golli+2^^>=(^o)i+P ^ 

(5.4) ||?X2||2 < \/k/{t - l)a 

^ ll^Solb 2crfc(xo)i + p 

~ Vi -1 

^ ||it5o + 2o-fc(g;o)i + p 

y/t — 1 \/k{t — 1 ) 


order tk 
^ and 


.pp(L(2)). 
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where z := ||/i 5 o + and R := jg ga,sy to check the following identity: 

{2d-i) Y. 

N N 2 ^ 

(5.5) = - df3,)\\^ - Y - dfimwl 


2=1 j = l 2=1 

provided that Aj = 1. Choose d = 1/2 in ()5.5p we then have 

N 2 ^ 

^ ^ “ 2 ^* ^ 2 “ 711^^*112 = 0 

2=1 2 = 1 

Note that for d = 1/2, 

1 


^((2 “ ^)(H + ^ 

= - d){hso ^ + 2 (^a{{]^ -/r)(/iSo + /i(^)) - + iJ?\\Ah\\l. 

It follows from Aj = 1 and AiRi that 

Ai| 

2=1 


N 


(5.6) 


I 1 2 ^ \. 

Y ■^*1 ^((2 “ ^ ~ 2“*) 2 “ f^){Mhso + h^^'>),Ah^ - Y jllMII 

2 2=1 


Set ^ = ^/t{t — 1) — {t — 1). We next estimate the three terms in (j5.6jl . Noting that 
\\hso\\o < k, ||M^)||o < i and ||nj||o < s = A:(t - 1) - we obtain 

IIAIIo < \\hso\\o + ll^^^^llo + Ikillo <t-k 

and ||(A - n){hso + - <t-k. Since A satisfies the RIP of order t ■ k with S, we 

have 


^ ||2 
- -Uih 


Al((^ - f^){hso + |[ < (1 + 5)||(i - /r)(/i5o + 

= (1 + ^)(^(2 “ l^)^ll(^So + + ^ll^illi) 

= (1 + ^)((^ - + ^Ihilli) 


and 

IIMIIi>(i- 


«II2 


— (1 — (5)(||/i5o + • llrtilli) — (1 “ d){z‘^ + • UniHi)- 
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Combining the result above with (15.2p and (15.4|) we get 

N 2 _ ^ 

0 < (1 + 5) ^ (^9 “ + /^(l “ fJ.)Vl + S ■ Z ■ € — {1 — 6) ^ 


2=1 


2=1 


^Ai(^(^(l+ 5)(^ - nf - +fi{l-fi)Vl + 6-z-^ 


2=1 

N 


— X] ~ -^ t - 1^ ) ~ /^)\/l + 5 • 2 


2=1 


= -t{i2t - 1) - 2^^) - S)z^ + • e + ^). + 


2(t-l) 


fJ- 
t — 


which is a quadratic inequality for z. We know 6 < ^J{t — l)/t. So by solving the above 
inequality we get 

-I ! ry 

{■\/t(t — 1)(1 + 5)e + 5i?) + — 1)(1 + 5)e + 6R)^ + 2t( (t — l)/t — 5)5i?^^ 


< 


< 


2ti^{t-l/t)-5) 

^t{t-l){l + S) ^ , 25 + ^J2t{^y{t-ljJt- 6)6 

tWit - i)A - <5) 


e + 


R. 


2t{y/{t - l)/t - 5) 

Finally, noting that ||/i 5 g||i < ||/i 5 p||i + Ry/k, in the Lemma [5l^ if we set m = N, r = k, 
A = Ry/k > 0 and a = 2 then ||/i 5 g ||2 < ||/i 5(,||2 + R- Hence 

ll^lb = \J\\hso\\l + \\hs-\\l 

— ^/ll^Solli + (ll^^olb + R)‘^ 

— '^2 11 hso 11 2 + .R + yf2z + R 

^ V^2(l + 5) ^ ^ / y/26 + ^t{^{t-l)lt-6)6 ^ \ ^ 

~ I - y/t/{t-l)6^^ t{y/{t-l)/t-6) ^ j 

Substitute R into this inequality and the conclusion follows. 

For the case where t • fc is not an integer, we set t* := Itk'l/k, then t* > t and 6t»k = 
6tk < \J We can then prove the result by working on 6t*k- B 
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